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Abstract — In this work a constrained adaptive filtering strategy 
based on conjugate gradient (CG) and set-membership (SM) 
techniques is presented for adaptive beamforming. A constraint 
on the magnitude of the array output is imposed to derive an 
adaptive algorithm that performs data-selective updates when 
calculating the beamformer's parameters. We consider a linearly 
constrained minimum variance (LCMV) optimization problem 
with the bounded constraint based on this strategy and propose 
a CG type algorithm for implementation. The proposed algorithm 
has data-selective updates, a variable forgetting factor and 
performs one iteration per update to reduce the computational 
complexity. The updated parameters construct a space of feasible 
solutions that enforce the constraints. We also introduce two 
time-varying bounding schemes to measure the quality of the 
parameters that could be included in the parameter space. A 
comprehensive complexity and performance analysis between 
the proposed and existing algorithms are provided. Simulations 
are performed to show the enhanced convergence and tracking 
performance of the proposed algorithm as compared to existing 
techniques. 

Index Terms — Adaptive beamforming, constrained optimisa- 
tion, adaptive algorithms, set-membership filtering. 



I. Introduction 

Constrained adaptive filtering algorithms have been devel- 
oped for several decades and found applications in many 
areas such as beamforming, system identification, and inter- 
ference suppression in code-division multiple-access (CDMA) 
systems [l]-[6]. For example, in beamforming problems the 
constraint corresponds to the knowledge of the direction-of- 
arrival (DOA) of the desired user, which is assumed known 
beforehand by the receive antenna. 

The popular constrained adaptive filtering algorithms in- 
clude stochastic gradient (SG), recursive least squares (RLS) 

[I] , affine projection (AP) [10], and conjugate gradient (CG) 

[II] . SG algorithms are attractive due to their low com- 
putational cost. However, the convergence of SG algorithms 
strongly depends on the selection of the step size value and 
thus they suffer from slow convergence or large misadjust- 
ment. RLS algorithms have fast convergence but are more 
complex to implement and may become unstable due to the 
divergence problem and numerical problems. The AP and CG 
algorithms can be viewed as alternatives with computational 
complexities and convergence performances between those 
of the SG and RLS algorithms. The AP algorithms require 
the inversion of a matrix whose dimension is given by the 
projection order [1], which can increase significantly the 
complexity of AP algorithms when the projection order is 
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high. Moreover, AP algorithms have a convergence rate that 
is significantly faster than the SG algorithm and can be signif- 
icantly slower than the RLS, depending on the step size and 
the environment. CG algorithms outperform AP algorithms in 
severe situations and have a comparable performance to the 
RLS, while requiring a lower complexity. 

In certain scenarios where the adaptive filters have a large 
number of parameters, or operate under constraints on the 
power consumption, the use of standard constrained adaptive 
algorithms is limited due to the high computational complex- 
ity. In this context, reduced-rank algorithms can be a highly 
effective solution [7] -[24]. Furthermore, set-membership (SM) 
techniques have been introduced into adaptive filtering [25]- 
[31]. SM algorithms specify a bound on the magnitude of 
the estimation error or the array output, and can reduce the 
computational complexity due to data- selective updates. SM 
techniques usually rely on two steps: 1) information evaluation 
and 2) parameter update. If step 2) does not occur frequently, 
and step 1) does not require much complexity, the overall 
complexity can be reduced significantly. SM techniques with 
the SG, RLS, and AP algorithms have been reported in [28]- 
[32], in which the SM-based algorithms achieve computation 
reduction without performance degradation compared with 
conventional algorithms. A CG algorithm with data selective 
updates has been reported in [31], which is named data 
selective conjugate gradient (DS-CG) here. 

The main contribution of this paper is to introduce an 
adaptive filtering strategy that combines the SM technique 
with the CG algorithm in order to solve a constrained op- 
timization problem. The proposed algorithm, which is termed 
SM-CG, achieves a fast convergence that is close to that 
of the RLS algorithm, employs a variable forgetting factor 
that allows excellent convergence and tracking performance, 
and requires a computational complexity that is much lower 
than its conventional counterparts. We present a linearly 
constrained minimum variance (LCMV) optimization problem 
[33] related to an SM bounded constraint on the array output, 
and we perform the filter optimization using a CG technique. 
The parameters are updated only if the bounded constraint 
cannot be satisfied. For the update, we introduce a CG-based 
vector v G C mxl to create a relation with the received 
covariance matrix R = E[rr^] and the array response of 
the desired user a(#o)> namely, v = R~ 1 a(0o), where m 
denotes the filter length, r G C m x 1 is the received vector, and 
#o is the DOA of the desired user. This procedure avoids a 
matrix inversion associated with the constraint on the array 
response. Unlike the work reported in [31], the proposed SM- 
CG method employs a variable forgetting factor to improve 



the convergence and tracking performance, a strategy based 
on an auxiliary vector to impose the constraint on the array 
response that makes our algorithm computationally simpler 
than [31] and a time- varying bound. We also introduce two 
time- varying bounds that extend the work in [37] to beamform- 
ing and incorporate parameter and interference dependence to 
reflect the characteristics of the environment for improving the 
tracking performance of the proposed algorithm in dynamic 
scenarios. Compared with the fixed bounded constraint in 
the existing algorithm, the time-varying bounding schemes 
are very effective at reducing the update rate and enhancing 
the output performance in dynamic scenarios. A complexity 
analysis is provided to show the advantage of the proposed 
SM-CG algorithm over the existing methods. To evaluate the 
proposed algorithm, we consider a beamforming application 
and the output signal-to-interference-plus-noise ratio (SINR) 
performance. We compare the proposed algorithm with the 
existing algorithms under both stationary and non- stationary 
scenarios. 

The paper is structured as follows. Section II briefly de- 
scribes the system model and states the LCMV optimization 
problem. Section III describes the constrained SM adaptive 
filtering framework, whereas Section IV presents the proposed 
constrained SM-CG adaptive filtering algorithm. Section V 
introduces two strategies to compute time- varying bounds. 
Section VI presents and discusses the simulation results, while 
Section VII gives the concluding remarks. 

II. System Model and LCMV Optimization Problem 

Let us suppose that q narrowband signals impinge on a 
uniform linear array (ULA) of m (q < m) sensor elements. 
The sources are assumed to be in the far field with DOAs 
9o,. . . ,6 q -i. The received vector r can be modeled as 

r = A(0)s + n, (1) 

where = [<9 , . . . , 6> g _i] T G R qxl is the DOAs, A(0) = 
[a(0o)> • • • •> a (0q-i)] £ C mxq contains the steering vec- 
tors a(0 k ) = [l^ e -^J^cose k ^^^-2nj(m-l)^cose k] T e 

C mXl , (k = 0, . . . , q — 1), where A c is the wavelength and 
d = A c /2 is the inter-element distance of the ULA, s G R qxl 
is the source data, n G C mxl is the white Gaussian noise, 
and (-) T stands for the transpose. The output of a narrowband 
beamformer is 

V = w ]I t\ (2) 

where w = [wi, . . . ,w m ] T G C mxl is the complex weight 
vector of the adaptive filter, and (-) H stands for the Hermitian 
transpose. 

The conventional LCMV optimization problem determines 
the filter parameters by solving 

minimize E[|?/| 2 ] = w H Rw 
subject to w H a(0o) = 7, 

where 7 is a constant corresponding to the magnitude of the 
constraint. The objective of (3) is to minimize the array output 
power while maintaining the contribution from #0 constant. 
The weight solution is w opt = qhT^^-^L ) • Many adaptive 



filtering algorithms have been reported to solve optimization 
problems. Among them the CG-type algorithms are promising 
due to their attractive tradeoff between performance and com- 
plexity. In what follows, we consider a constrained adaptive 
filtering framework with the SM technique. 

III. Constrained SM Adaptive Filtering 
Framework 

For conventional constrained adaptive filtering techniques, 
the received vector r is processed by the LCMV filter w 
to generate the array output y. The parameters of w have 
to be updated at each time instant, which results in a high 
computational load when the filter length (the number of 
elements in the array) is large. Differently from conventional 
algorithms, SM-based techniques employ a check block with 
a specified bound 5 on the amplitude of the array output y. 
The bound is assumed here to be time-varying and related 
to the previous estimated parameters of the weight vector. It 
is clear that, at each time instant, some valid estimates of 
w are consistent with the bound. Therefore, the solution to 
the new strategy is a set in the parameter space [28]. Some 
estimates even satisfy the constrained condition with respect 
to different r for different time instants. The parameter update 
is performed only if the bounded constraint \y\ 2 < S 2 cannot 
be satisfied. This strategy leads to data- selective updates and 
ensures that all the updated parameters satisfy the constraint 
for the current instant. It implies that this scheme will have a 
reduced computational complexity. 

Let Hi denote the set containing all the estimates of w for 
which the associated array output at time instant "i" is upper 
bounded in magnitude by 5, which is 

Hi = {weC mxl : \y\ 2 <5 2 }, (4) 

where Hi is bounded by a set of hyperplanes that correspond 
to the estimates of w. It is given to enforce the bounded 
constraint and thus is referred to as the constraint set. It 
should be remarked that Hi includes the estimates for the 
current instant. We then define the exact feasibility set 0$ as 
the intersection of the constraint sets over the time instants 
I = 1, . . . , i, which is described by 

i 

e,= p| H u (5) 

1=1 

(so,r)eS 

where sq corresponds to the transmitted data of the desired 
user and S is the set including all possible data pairs {so, r}. 
The constrained SM approach only performs updates for those 
estimates which belong to this feasibility set. In practice, 
it is impossible to traverse all possible data pairs. Under 
this condition, the constrained SM framework works with 
the membership set constructed from the observed data pairs, 
which is given by = Hl=i Note that the feasibility set 
is included in the membership set. The two sets are equal only 
if all possible data pairs are traversed up to time instant i. 

The constrained adaptive filtering strategy that will be 
detailed in what follows employs the SM technique with a 
constrained adaptive CG-based algorithm. The convergence 



and tracking performance is enhanced due to the variable 
forgetting factor, whereas the computational complexity is 
reduced due to the data- selective updates which bring the 
update rate down. Note that, according to the nature of many 
dynamic scenarios, the time-varying bound should be selected 
appropriately to describe the characteristics of the environment 
and to improve the output performance. We will detail the 
development of the algorithm in the next section. 

IV. Proposed SM-CG Adaptive Algorithm 

In this section, we introduce a constrained optimization 
strategy that combines the SM technique with the LCMV 
design and utilizes the CG-based adaptive filtering algorithm, 
as depicted in Fig. 1. The basic idea is to introduce a 
SM check that leads to the update of the beamformer when 

\v\ 



> S 2 and no update when \y\ 2 < S 2 . 



LCMV Filter w 



Yes, update 



SM check 

\y? > s 2 



SM-CG 
Algorithm 



No, do not update 



Fig. 1. Proposed constrained SM adaptive filtering strategy. 

We develop a CG-based adaptive algorithm based on the SM 
technique to compute the parameters of the adaptive beam- 
former. The development starts from an LCMV optimization 
problem that incorporates the time- varying bound into the set 
of constraints as given by 

minimize w H Rw 



subject to w H a(0o) = 7 whenever \y\ 2 > 5 2 



(6) 



where 5 determines a set of estimates of w within the 
constraint set % for each time instant and R is an estimate of 
the covariance matrix of the received vector r described by 
R = E[rr H ]. 

We transform the constrained optimization problem into an 
unconstrained one using the method of Lagrange multipliers 
[1] and consider an equality as the second constraint in (6). 
The algorithm will update whenever \y\ 2 > S 2 . We then 
employ an exponentially weighted cost function with time 
index i expressed by 



L(w(i),\ 1 (i),\2 



i-1 

1=1 



X\- l (i)w H (i)r(l)r H (l)w(i) 



+ 2\ 1 (i)M{\y(i)\ 2 - S 2 (i)} + 2\ 2 &{w H (i)a(0 ) - 7}, 

(7) 

where $?{•} selects the real part of the argument, Xi(i) plays 
the role of forgetting factor and Lagrange multiplier with 
respect to the bounded constraint and is calculated only if 



the bounded constraint is satisfied. The scalar A2 is another 
Lagrange multiplier that ensures the constraint on the array 
response of the desired user. 

For further derivations, we assume that X\(i) is close to 1, 
which is consistent with the setting of the forgetting factor in 
[1]. Under this condition, the solution of the beamforming 
problem in (6) is given by w(i) = — lR — 9 where 

a H (0 o )R (i)a(Oo) 

R{i) = R(i — 1) + Xi(i)r(i)r H (i) is an alternative form to 
estimate the covariance matrix R. This expression is similar to 
that of the conventional LCMV solution. The main difference 
is that, in the proposed scheme, the bounded constraint reduces 
the update rate and provides valid estimates of w to construct 
the feasibility set \£^. 

To solve the optimization problem, we define a CG-based 
vector that exploits a relation with the received covariance 
matrix and the array response of the desired user given by 

v(i) = R~\i)a(6 ). (8) 
Using this relation, the weight vector can be written as 

jv(i) 



w(i) 



(9) 



where v(i) is regarded as an intermediate parameter vector to 
guarantee the constraints and to avoid the matrix inverse. We 
intend to perform one iteration per update to calculate v(i) 
and the weight vector w(i). 

According to the methodology of the CG algorithm [11], 
the CG-based update rule of the auxiliary vector v(i) is given 
by 

v(i) = v(i - 1) + a(i)p(i), (10) 

where a(i) is a step- size coefficient and p(i) is a direction 
vector that is obtained by a linear combination of the pre- 
vious direction vector and a negative gradient vector g(i) of 
J(v(i)) = v H (i)R(i)v(i) - 2U{v H (i)a(0 o )} with respect to 
v*(i), which is 

g(i) = a(0 o ) - R(i)v(i) 

= g(i - 1) - a(i)R(i)p(i) - Ai(i)r(i)r H (i)v(i - 1). 

(11) 

We employ an inexact line search scheme with re- 
duced complexity to calculate v(i). The step-size coefficient 
should satisfy the convergence bound < p H (i)g(i) < 
0.bp H (i)g(i — l) according to [11]. From this bound and (11), 
we have 



< 



(12) 



0.5p H (i)g(i - 1) - Xi(i)p H (i)r(i)r H (i)v(i - 1) 
p H (i)R(i)pti) 
< p H (i)g(i) - Ai(z)p g (z)r(z)r g (z)i;(z - 1) 
p*(i)R(i)p(i) 
The relations in (12) are satisfied if a(i) is 

(1 - r])p H (i)g(i - 1) - Xi(i)p H (i)r(i)r H (i)v(i - 1) 



*(<) 



where < 77 < 0.5. 



p H {i)R[i)p[i) 



(13) 



4 



Substituting (10) and (13) into the bounded constraint, 
and performing some algebraic manipulations, we obtain the 
expression for the coefficient Xi(i), which is 



TABLE I 

THE PROPOSED SM-CG ALGORITHM 



MO 



An(i) - Xi2(i) 
Ai3(«) - Ai 4 (i)' 



(14) 



where 

An(i) = ri(i)sign{ri(i) - r 2 (i)} 
A12 W = r 3 (i)sign{r 3 (i) - r 4 (i)} 
Ai 3 (0 = r 2 (i)sign{r 1 (i) - r 2 (i)} 
Au(i) = r 4 (i)sign{r 3 (i) - r 4 (i)} 

n(i) = (5(i) V if (i-l)a(^o)p if (i)^(i)p(i)+^(i)(l-r7)^(i- 
l)p(;)p^(;)a(0 o ) 

r 2 (i) = - l)r(i)r ijr (i)p(i)p^(i)a(6>o) 

r 3 (i) = - l)r(i)p H (i)R(i)p(i) + (1 - 77)0^(2 - 

l)p(i)p jF/ (i)r(i) 

T4(i) = — l)r(i)r H (i)p(i)p H (i)r(i). 

The details of the derivation are shown in the appendix. 

It should be remarked that X±(i) is adaptive, and involves 
the estimated parameters and the time- varying bound. Unlike 
in conventional adaptive algorithms that employ a forgetting 
factor which is usually a fixed real value close to 1, in the 
proposed SM-CG algorithm Ai(i) is adaptive, can follow the 
changes of the scenarios and improves the tracking perfor- 
mance. This is a feature that is not available in the algorithm 
in [31]. Furthermore, it avoids the divergence problem caused 
by the setting of the forgetting factor and thus ensures a stable 
steady-state performance of the proposed algorithm. 

The direction vector p(i) is 



p(i + l) =g(i)+P(i)p(i), 



(15) 



where /3(i) is chosen to provide conjugacy [34] for the 
direction vector and is given by 



p H (i)R(i)g(i) 
p H (i)R(i)p(i)' 



(16) 



The proposed SM-CG algorithm is summarized in Table I, 
where the initialization is set to enforce the constraint with 
respect to a(0o) and to start the update. The coefficient Ai(i) 
is calculated only if the bounded constraint cannot be satisfied, 
so as the update of the parameters. During the update, the 
proposed algorithm runs only one iteration to calculate the 
CG-based vector for the weight solution, which requires much 
less computational cost in comparison with existing CG-based 
algorithms [11], [34]. 

V. Schemes to Compute Time-Varying Bounds 

The bound 6 is a scalar coefficient for the SM technique to 
check if the parameter update should be performed or not. It is 
an important parameter to measure the quality of the estimates 
that could be included in the feasibility set 6^. In [25], 
[28] -[32], several predetermined bounding schemes have been 
reported for development of the adaptive algorithms, which 
achieve reduced complexity without performance degradation. 
However, they may suffer from the risk of underbounding 
(the bound is smaller than the actual one) or overbound- 
ing (the bound is larger than the actual one). Besides, the 



Initialization: 

0(0) = p(l) = a(0 o ); w(0) = a(6o)/\\a(6 )\\ 2 . 
For each time instant i — 1 , . . . , N 

y(i) — w H (i — l)r(i) 

5(i) (PDB or PIDB scheme) in (17) or (23) 

if \y(i)\ 2 >S 2 (i) 

Ai(i) = ^ff"* 12 ^ 

v ' Ai 3 0)-Ai4(Y) 

R(i) = R(i - 1) + Xi(i)r(i)r H (i) 

(A) = (l~ri)p H (i)g(i-l)-\i(i)p H (i)r(i)r H (i)v(i-l) 
\ ' p H (i)R(i)p(i) 

v(i) = v(i — 1) + a(i)p(i) 

g(i) = g(i - 1) - a(i)R(i)p(i) - X!(i)r(i)r H (i)v(i - 1) 

^ V J p H (i)R(i)p(i) 

p(i + 1) = g(i) + P(i)p(i) 

else 

v(i) — v(i — 1) 

end 

— TtjCj) 



predetermined bound cannot reflect the characteristics (time- 
varying nature) of the environment and thus may result in poor 
convergence and tracking performance in dynamic scenarios. 

Here we introduce two alternative bounding schemes that 
are time-varying instead of the predetermined bounds to en- 
hance the convergence and tracking performances. The first 
scheme, which is called parameter dependent bound (PDB), is 
an extension to the work reported in [35] -[37] which involves 
the CG-based parameters of the proposed SM-CG algorithm. 
The PDB recursion is 



= gS(i - 1) + (1 - <?)aAIMI 2 ^(0> 



(17) 



where g is a forgetting factor that should be adjusted to 
guarantee a proper time-averaged estimate of w(i), s > 1) is 
a tuning coefficient to adjust \\w(i) || 2 o"^ (z) in order to provide 
information on the evolution of the power of w(i), and (i) 
is an estimate of the noise power. We assume that the noise 
power is known beforehand at the receiver. This time- varying 
bound formulates a relation between the estimated parameters 
and the environmental coefficients. It provides a smoother 
evolution of the weight vector trajectory and thus avoids too 
high or low values of the squared norm of the weight vector. 

Another time- varying bounding scheme combines the PDB 
with an interference estimation procedure, which is a little 
more complex than the PDB but has an improved performance 
since it provides more information about the environment 
for parameter estimation [39]. It is termed parameter and 
interference dependent bound (PIDB) and is an extension of 
[39] for array signal processing. Differently from [39], this 
scheme employs the steering vector of the desired user and the 
beamforming filter to subtract the components of the desired 
user from the output of the steering vector for estimating the 
multiple access interference (MAI) power level, as depicted in 
Fig. 2. 

In this structure, the received vector r(i) is processed by the 
SM-CG strategy and the steering vector a(6o), respectively, to 
generate the array output y(i) and the component with respect 
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Framework 



Steering 
Vectora(^o) 



2/0 (0 



5(0 



+ 



PIDB 

n 



MAI 
Estimation 



Fig. 2. PIDB bound structure 



to the desired user yo(i), which is 
y o (i) = a H (0 o )r(i) 



9-1 



so (0 + V a H (0 )a(O k )s k (i) + a* (0 o )n(z), (18) 



MAI 

where (fc = 0, . . . , g — 1) denotes the transmitted data 

from the kth user. 

The second-order statistics of the output of the steering 
vector is 

q-l q-l 

n\yo^\ 2 } = X;E E ^( < )^(0]a H (fio)a(ft)a H (fl fc )a(»o) 
+ E[| So (i)| 2 ] + a H (9 )E[n(i)n H (i)]a(0„) 

9-1 

= J2 E [\ s k(i)\ 2 ]a H (e o )a(9 k )a H (9 k )a(0 o ) 

k=l 

+ E[| So «| 2 ] + ^, 

(19) 



where a 2 is the noise variance and the second expression is 
obtained since we assume that source data are transmitted 
independently. From (19), the second-order statistics can be 
used to identify the sum of the power level of the MAI and 
noise terms. 

Assuming that the algorithm converges, we should have 
y(i) —> so(i). According to the PIDB structure, the instan- 
taneous estimate of the MAI and noise can be obtained by 
subtracting y(i) from yo(i), which is given by 

eo(i) = yo(i)-y(i) 

«^E[| Sfc (i)| 2 ]a^(^o)a(^)^(i) + a H (^ )n(i). 

k=l 



MAI 



(20) 



Taking the expectation with respect to | eo (i) | 2 and consid- 
ering the MAI and noise uncorrelated, we have 



q-l 



fc=i 



(21) 

where it represents the interference and noise power. By using 
time averages of the instantaneous values, we could obtain an 
estimate of (21), which is 



where g is a forgetting factor to ensure a proper time-averaged 
estimate of the interference and noise power. 

The information of the interference and noise power can 
be incorporated into the bounding scheme, which leads to the 
PIDB expression 



^(i) = ^(i-l) + (l-£)|e (i)| 2 , 



(22) 



S(i) = gS(i - 1) + (1 - Q)[y/^) + v^IKO ll 2 ^)L (23) 

where e is a weighting parameter that should be set. The 
expression in (22) avoids instantaneous values that are un- 
desirably too high or too low, and thus circumvents inap- 
propriate estimates of S(i). Compared with (17), the PIDB 
involves the estimation of the interference and noise power 
and provides more information to track the characteristics of 
the environment, which benefits the convergence and tracking 
performance. 

VI. Complexity Analysis 

In this section, we show the computational complexity 
requirements for the proposed SM-CG algorithm and compare 
it with those of the existing algorithms. The computational cost 
is measured in terms of the number of complex arithmetic 
operations, i.e., additions and multiplications. The results are 
listed in Table II, where m is the number of sensor elements, 
N is the total number of snapshots, r (0 < r < 1) is the 
update rate for the adaptive algorithms with the SM technique, 
and L is the number of the observed received vector in the 
signal matrix of the AP and DS-CG algorithms. Note that the 
calculations of the time- varying bound are based on (17) for 
all the algorithms. 

From Table II, the update rate r impacts the complexity sig- 
nificantly. Specifically, for a small value of r, the complexity 
of the algorithms with the SM technique is much lower than 
their conventional counterparts that have r = 100% since the 
SM algorithms only perform updates for a small number of 
snapshots. For a very large r (e.g., r = 1), the SM-based 
algorithms are a little more complex due to the calculations 
of the time- varying bound and the related coefficients. In most 
cases, the update rate has a relatively small value (around 
10% — 20%) and thus leads to a reduced complexity. 

Fig. 3 provides a more direct way to illustrate the computa- 
tional requirements for the adaptive algorithms. It includes the 
complexity in terms of additions and multiplications versus the 
number of sensor elements m. It should be remarked that r 
is different with respect to the different algorithms, which are 
set to ensure a good output performance. The specific values 
are given in the figure. From Fig. 3, the adaptive algorithms 
with the SM technique require much less computational cost 
than their conventional counterparts. The proposed SM-CG 
algorithm keeps a small update rate (r = 6.0%), which is 
lower than those of other SM-based algorithms. The curves 
of the SM-CG are situated between those of the SM-SG and 
the SM-RLS algorithms. As m increases, the complexity of 
the proposed SM-CG algorithm is slightly higher than that 
of the SM-AP algorithm. However, the latter cannot achieve 
as good performance as that of the proposed one. This fact 
will be shown in the simulation results. We also compare 
the proposed SM-CG algorithm with the DS-CG algorithm of 
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TABLE II 

Computational complexity of algorithms 



Algorithm Additions Multiplications 



SG 


N(3m - 1) 




iV(4m + 1) 


SM-SG 


2Nm + 3r Nm 




iV(2m + 5) + rN(4m + 3) 


RLS 


N(Am 2 - m - 1) 




7V(5m 2 + 5m - 1) 


SM-RLS 


2Nm + rN(4m 2 - 1) 




N(2m + 5) + rN(5m 2 + 6m + 2) 


SM-AP 


N(2m + 1) + riV[(m - 1)L 2 + 


mL + 1] 


N(2m + 5) + tN[L 3 + mL 2 + (m + 1)L + m + 2] 
N{2m 2 + 11m + 5) 


CG 


N{2m 2 + 7m + 1) 




DS-CG 


rN{2m 2 + 8m - 2) + LN{m - 1) 


rN(2m 2 + 9m + 3) + LNm 


SM-CG 


27Vm + rN(2m 2 + 8m + 


6) 


N{2m + 5) + rN(2m 2 + 9m + 22) 



[31]. As the update rate of the DS-CG algorithm (22.1%) is 
much higher than that of the proposed algorithm (6.0%), the 
complexity of the former is typically higher than the latter. The 
number of the received vectors L (L = 3 in this experiment) 
used for processing also increases the complexity. 




4 8 12 16 20 24 28 32 36 40 
Number of Sensor Elements 
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Fig. 3. Complexity in terms of arithmetic operations versus the number of 
sensor elements m. 



VII. Simulations 

We evaluate the SINR performance of the proposed SM- 
CG algorithm with the LCMV design and compare it with 
the existing SG, RLS, AP, and CG algorithms with/without 
the SM technique [1], [ll]-[26], [28], [32]. In all simulations, 
we assume that there is one desired user in the system and 
the related DOA is known by the receiver. Simulations are 
performed with a ULA containing m = 16 sensor elements 
with half- wavelength interelement spacing. The results are 
averaged by 500 runs. We consider the binary phase shift 
keying (BPSK) modulation scheme and set 7 = 1. 

In Fig. 4, we first compare the SINR performance of 
the proposed SM-CG algorithm with the existing DS-CG 
algorithm in [31]. We consider a scenario with q = 10 users 
in the system. The input signal-to-noise ratio (SNR) is 10 
dB and the interference-to-noise ratio (INR) is 30 dB. The 
total number of snapshots is N = 4000. The coefficients are 
A = 0.999, r] = 0.8, L = 3, S = 0.001 for the DS-CG 
algorithm. The bound used for the analyzed algorithms is fixed 
and chosen as yjha\. The curves of the RLS algorithm and 
the MVDR solution are included for comparison. It is clear 



that the convergence rate of the proposed SM-CG algorithm is 
faster than that of the DS-CG algorithm. The proposed SM-CG 
algorithm employs the variable forgetting factor to enhance 
the performance. The update rate of the proposed algorithm 
(6.0%) is much lower than that of the DS-CG algorithm 
(22.1%). It should be remarked that we have compared the 
SM-CG and DS-CG algorithms in numerous other scenarios. 
The SM-CG algorithm has consistently performed better than 
the DS-CG algorithm and required lower update rates than 
those of the DS-CG technique. 
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Fig. 4. Output SINR versus the number of snapshots. 

In Fig. 5, we show the SINR performance of the proposed 
SM-CG algorithm with the fixed and time- varying bounds. 
There are q = 10 users in the system. The input signal-to- 
noise ratio (SNR) is 10 dB and the interference-to-noise ratio 
(INR) is 35 dB. The total number of snapshots is TV = 3000. 
The proposed algorithm is performed with the fixed bounds 
5 = 0.8, 1.0, 1.3, the PDB and PIDB schemes. The coefficients 
are c = 21, g = 0.9, r] = 0.5 for the PDB, and s = 0.98, 
q = 19, r] = 0.5, e = 0.001 for the PIDB, respectively. 
We find that the curves with the fixed bounds experience an 
increase trend and then a decrease trend due to the divergence 
problem [1]. In these cases, it is necessary to utilize the 
regularization procedure periodically and set an appropriate 
forgetting factor to avoid the divergence. For the proposed SM- 
CG algorithm, this problem is minimized since the coefficient 
Ai(i) is variable according to the time- varying bound and 
thus circumvents the risk of divergence. The curves with 
the time-varying bounds have much lower update rates than 
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those with the fixed bounds. From Fig. 5, the curve with the 
PIDB exhibits a slightly superior convergence performance 
over that with the PDB since the former involves the estimation 
of the interference and noise power. For comparison and 
clear statement, we only show the results of the proposed and 
existing algorithms equipped with the PIDB scheme in what 
follows. 
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Fig. 5. Output SINR versus the number of snapshots. 

In Fig. 6, we show the output SINR performance of the 
proposed and existing algorithms versus the number of snap- 
shots. The scenario is the same as that in Fig. 5 except the 
input INR= 30 dB. The related coefficients are c = 21, 
g = 0.9, and r] = 0.5. The coefficient Ai(i) is limited to 
0.1 < Ai(i) < 0.999 in accordance with the setting of the 
forgetting factor. From Fig. 6, the algorithms with the SM tech- 
nique show superior convergence over the standard algorithms. 
The proposed SM-CG algorithm has a fast convergence that 
is close to that of the SM-RLS algorithm and reaches the high 
steady-state performance close to the minimum variance dis- 
tortionless response (MVDR) solution. It should be remarked 
that the update rate for the proposed SM-CG algorithm is 
only r = 6.0% (178 updates for 3000 snapshots), which is 
lower than those of the existing algorithms and reduces the 
computational cost significantly. 

The next experiment exhibits the performance of the time- 
varying bound 5(i) for the proposed and existing SM-based 
algorithms under the same scenario as in Fig. 6. The time- 
varying bound reflects the convergence performance and also 
the update rate. From Fig. 7, we find that the curve of the time- 
varying bound for the proposed SM-CG algorithm is close 
to that for the SM-RLS algorithm. It reaches the steady-state 
rapidly and has a small update rate. 

Fig. 8 evaluates the SINR performance of the algorithms 
with different input SNR values. There are q = 10 users in 
the system. The input SINR varies between dB and 30 dB. 
It is clear that the SINR values of all the algorithms increases 
with the increase of the SNR values, as expected. The proposed 
SM-CG algorithm exhibits a performance that is close to the 
SM-RLS method and better than other existing techniques. 
In Table III, we provide the update rates for the proposed 
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Fig. 6. Output SINR versus the number of snapshots. 
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Fig. 7. Time- varying bound versus the number of snapshots. 



and existing algorithms with respect to different input SNR 
values. It shows that the update rates of the proposed SM-CG 
algorithm always keep a low level with different SNR values. 

The last experiment is provided to show the tracking per- 
formance of the proposed and existing algorithms in a non- 
stationary scenario, namely, when the number of interferers 
changes in the system. The system starts with q = 8 users. 
The input SNR is 10 dB and the INR is 35 dB. The proposed 
algorithm converges rapidly to the steady-state. The system 
experiences a sudden change at N = 3000. We have 4 more 
interferers entering the system. This change degrades the SINR 
performance for all the algorithms. The algorithms with the 
SM technique track this change quickly and reach the steady- 
state again since the data- selective updates reduce the number 
of updates and thus lead to a faster convergence. Also, the 
PDB scheme provides information for the algorithms to follow 
the changes of the scenario. The proposed SM-CG algorithm 
exhibits a good tracking performance with a relatively low 
update rate (r = 6.2%). 
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TABLE III 
Update Rates For Different Algorithms 





(dB) 


5 (dB) 


10 (dB) 


15 (dB) 


20 (dB) 


25 (dB) 


30 (dB) 
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14.7% 


16.9% 


19.8% 


21.2% 


15.5% 
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17.2% 


SM-RLS 


6.8% 
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6.3% 
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8.3% 


SM-AP 
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5.6% 
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6.0% 


5.9% 




10 15 20 

Input SNR (dB) 



Fig. 8. Output SINR versus different input SNR values. 
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Fig. 9. Output SINR versus the number of snapshots in dynamic scenario 
with additional users enter and/or leave the system. 



VIII. Conclusions 

We have introduced a new adaptive filtering strategy that 
combines the SM technique with the adaptive CG algorithm 
for the design of LCMV beamformers. A bounded constraint 
has been incorporated in this strategy to realize the data- 
selective updates for the weight solution with a reduced 
computational cost. During the update, a CG-based parameter 
vector is used to exploit a relation between the covariance 
matrix inverse and the steering vector of the desired user. 
The proposed strategy enforces the constraint with respect 
to the steering vector and avoids the matrix inversion and 
employs a time-varying forgetting factor. The proposed SM- 



CG algorithm constructs a space of feasible solutions that 
retain the contribution of the desired user and satisfy the 
bounded constraint. A complexity analysis has been carried out 
to show the computation reduction achieved by the proposed 
SM-CG algorithm. Simulation results have shown excellent 
convergence and tracking performance for the SM-CG algo- 
rithm. 

Derivation of (14) 

In this appendix, we derive the expression of the coefficient 
Ai(i) in (14). Using the bounded constraint in (6) and y(i) = 
w H (i)r(i), we have 

\w H (i)r(i)\ 2 = S 2 (i). (24) 

Substituting the weight expression (9) into (24), the bounded 
constraint can be given by 

\v H (i)r(i)\ 2 = 5 2 (i)\v H (i)a(6 )\ 2 , (25) 

which is equivalent to 

v H (i)r(i)sign{v H (i)r(i)} = S(i)v H (i)a(0 o )sign{v H (i)a(6 )}. 

(26) 

Substituting (13) into (10), the CG-based vector v(i) can be 
expressed by v(i — 1), p(i), g(i — 1), and S(i), which 

is 

v(i) = v(i — 1) 

Xi(i)p H (i)[g(i - 1) - a(0 o )]p(i) - f]P H (i)9(i ~ 1)P(0 



+ 



p H (i)R(i)p(i) 



(27) 

Substituting (27) into (26), multiplying the term 
p H (i)R(i)p(i) on both sides of (26), and performing 
mathematical transformations, we obtain the expression for 
the coefficient Ai(i) in (14). 
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